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develops a concise, realistic plan for improving the program and 
solving problems related to its operation. The report discusses the 
historical development of focus visits, the institutional assessment 
preceding a focus visit, preparation for the focus visit, and the 
program improvement team. It describes the following parts of focus 
visit: the welcome with explanation of the purpose and background 
information on the program being examined, discussion of possible 
issues, tour and assessment of the program's facilities, formation of 
workgroups, the two workgroup meetings to identify needs of the 
program and to develop solutions to meet the most important needs, a 
student forum to allow students to speak candidly about what they 
like and dislike about the program, meeting of the entire program 
improvement team for a large-discussion, and evaluation of the focus 
visit by each team member. The report also offers suggestions for 
following through with the focus visit and provides reasons for their 
success. (Appendixes include sample agendas, lists of potential 
issues for workgroups, and sample forms,) (YLB) 
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Introduction 

In 1993, Minnesota's State Board of Technical Colleges (SBTC) implemented a 
new process, known as focus visits, for evaluating and improving technical college 
programs. A focus visit is a full-day activity that takes place on the technical college 
campus which houses the program being evaluated. A team of ten to twenty-five 
people familiar with the program (i.e., program faculty, former students, current 
students, technical college staff, advisory committee members, and employers) 
develops a concise, realistic plan for improving the program and solving problems 
related to its operation. 

Focus visits are much more than one-day 
events, however. They are both a process and a 
way of thinking. Focus visits are a process 
because the work happening before and after the 
actual one-day events are on-going and every bit 
as important as the events. They are a way of 
thinking because the values and beliefs 
undergirding this process are critical to their 
success. Going through the motions of a focus 
visit without embracing these values and beliefs is 
likely to yield few positive results. 

The focus visit process has been very well 
received by technical college faculty, 
administrators, staff, and students. Furthermore, 
the SBTC and other state agencies concluded that 
this process is exceptionally effective as a means for improving technical college 
programs. Several vulnerable programs have been revitalized and restored to success 
as a result of focus visits. For example, the Computer Careers program at Dakota 
Countv Technical College was suffering from low enrollment and low placement. 
During a focus visit, representatives from business and industry noted that the 
curriculum and equipment for the program were seriously outdated and 
recommended that the college administrators address these issues. The college acted 
upon these recommendations. Today the problems with placement have 
disappeared, and the program is filled to capacity. The college is planning to expand 
the program in the fall of 1996. 

Focus visits are built on a process improvement model of evaluation instead of 
a compliance monitoring model. The purpose of focus visits is not to find the 
weaknesses of programs and document them. Rather, it is to find new and creative 
ways of improving programs. Focus visits are intended to be non-threatening. They 
are also designed to give the people most intimately connected with the 



"My strongest impression of 
the focus visits I attended is 
that they were so positive ... 
Often , anything related to 
evaluation tends to be a 
negative experience, hut focus 
visits were perceived by . the 
faculty who participated in 
them to be a really positive 
experience " ’ ’ 

Debbie Drinkard Grovum 
Counselor 

Northwest Technical College 
Bemidji Campus 
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program — the faculty, students, and potential 
employers — the greatest amount of input, as well 
as a major share of control over the process and 
outcomes of the focus visit. 

The purpose of this report is to capture the 
historical development of focus visits and 
document the way they are conducted. One of 
the primary goals of this document is to provide 
enough information for technical colleges and 
similar institutions to conduct their own focus 
visits. Another goal is to illuminate the key 
factors which have made this process so 
successful. It is the hope of the State Council on 
Vocational Technical Education that focus visits 
will continue to be conducted throughout our state's technical colleges and the use of 
this process will be extended to include Minnesota's community colleges and state 
universities. Furthermore, it is the desire of the State Council that the spirit of the 
focus visit process prevail and permeate the continuous improvement efforts of 
postsecondary education for all Minnesotans. 

It is important for the authors of this report to note that, during the time this 
report was being prepared, the technical college system in Minnesota merged with 
the community college system and the state university system. The combined system 
is known as Minnesota State Colleges and Universities (MnSCU). Although the focus 
visit process was developed under the SBTC, focus visits are now under the direction 
of MnSCU. 



"Focus visits cover a wide 
range of services and provide , 
for an evaluation that brings • 
about change. The feedback 
received from students and 
employees is the strength of 
the process . Many excellent f e ' 
changes have been initiated 
through focus visits " r , , *4’ 

Dr* ^Vem Treat C; ; ^ ^ ^ 

Dean of Student Affairs ' * 

Northwest Technical College ■>;•* 
Bemidji Campus l ’;r 



Historical Development 

In 1973, the United States Department of Education authorized the State Board 
of Technical Colleges (SBTC) to be the agency responsible for accrediting Minnesota's 
technical colleges. The SBTC developed a comprehensive and rigorous accreditation 
procedure which included three components: an institutional self-study, an on-site 
visit conducted by a team of qualified evaluators, and an institutional improvement 
plan for monitoring corrective action. Each technical college was reviewed for 
accreditation once every five years using this procedure. One year prior to its 
scheduled on-site visit, each institution completed a self-study — identifying the 
strengths and weaknesses of each program, as well as those of the school's 
administration. The on-site visits typically lasted three to four days, and the 
evaluation teams involved upwards of 100 people (Wood, 1995). The institutional 
improvement plans developed from the on-site visits were typically between 200 and 
1000 pages in length. In short, these on-site visits and the resulting institutional 
improvement plans could be described as immense and daunting. The on-site visits 
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obviously required tremendous state and local resources and often proved to be a 
distraction to the institution's faculty, staff, and students. The institutional 
improvement plans contained an overwhelming amount of information of 
intimidating specificity. Consequently, this process sometimes resulted in little 
institutional change. 

Beginning in 1993, focus visits replaced on-site visits as the primary means of 
evaluating individual technical college programs. Several factors served as the 
impetus for this shift. First, Minnesota's technical colleges have gradually undergone 
the process of becoming accredited by the North Central Association of Colleges and 
Schools (NCA). Today, all but four of Minnesota's technical college campuses have 
received NCA accreditation. The process of receiving NCA accreditation is, in many 
ways, similar to the old SBTC accreditation process. However, one major difference 
is that the NCA accreditation process focuses on entire institutions, not individual 
programs. Focus visits were designed to provide a mechanism for the evaluation and 
improvement of individual technical colleges programs. As such, focus visits are an 
excellent complement to the NCA accreditation process. 

.Another impetus for the development of the focus visit process was to reduce 
the amount of state and local resources required to implement on-site visits. 

Provision of food and housing for up to 100 people is quite costly, and managing the 
logistics of meetings, interviews, and campus tours for that number of people 
requires a major investment of staff time. Focus visits were designed to do just what 
their name implies — focus. Instead of examining each program at a technical college, 
focus visits can be used to examine the two or three programs most in need of help. 
Furthermore, instead of creating copious reports, focus visits were designed to 
identify the most salient issues, develop creative solutions, and report only on those. 

During the same period the focus visit process was being developed, there 
were two other processes under development at the SBTC which impacted the 
evolution of the focus visit process. The first of 
these was the development by the SBTC of a 
model for identifying programs that were not 
performing adequately. This process became 
known as the program review model. The SBTC 
established performance standards in several 
areas. If a program fell below these minimum 
standards it was reviewed by the SBTC and was 
subject to the potential loss of its state funding. 

The criteria used by the SBTC for the program 
review model were eventually organized into two 
sets of standards known as the mission test and 
the efficiency test. Review of the results of the 
mission and efficiency tests are the starting points 
for the focus visit process. The criteria used for 

9 



", Focus visits have been 
successful due. to the inclusion 
of a variety of individuals 
and stakeholders in an open, 
frank discussion of pertinent 
issues. Also, the process, by 
design, produces achievable 
goals." 

Tom Girtz 

Dean of Curriculum 

Red Wing/Winona Technical College 
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these tests are part of the institutional assessment 
which precedes a focus visit. This institutional 
assessment is discussed in the next section of this 
report. 

The second process which impacted the 
evolution of focus visits was the development of 
standards and measures in accordance with the 

Carl D. Perkins Vocational and Applied . 

Technology Act of 1990. In order to fulfill the mandates of the Perkins Act the SBTC 
developed a list of ten standards and measures to be used as benchmarks of quality 
for technical college programs. These standards and measures eventually became 
known as the effectiveness test . The effectiveness test also has become incorporate 
into the institutional assessment preceding a focus visit. The major forces and events 
which shaped the focus visit process are summarized in Figure 1 on page five. 

The first focus visit was conducted for the Surgical Technician program at 
Duluth Technical College in April, 1993. Using feedback from the focus visit 
participants, the process was revised. An additional 16 focus visits were conducte 
during the 1993-94 school year (SBTC, 1994). Today, the focus visit process is still 
being improved based on feedback from focus visit participants. 



"Everyone in our building is 
supportive of the focus visit 
process:.; I don't know of one 
nay-say er" ; ; ; 

Dr. Jerry J. Johnson 
Dean of Instruction i 

Dakota County Technical College 



The Institutional Assessment Preceding a Focus Visit 

Although focus visits are not intended to examine every program at a technical 
college, the process of selecting the two or three programs which do receive focus 
visits involves an annual institution-wide assessment of every program at the college. 
This assessment has proven to be a valuable and fruitful starting point for the focus 

visit process. 

The decisions concerning which technical college programs receive focus visits 
are not made at the state level. Rather, those decisions are made locally by the 
colleges as a result of their institutional assessments. An emphasis on local control is 
one of the key themes characterizing the focus visit process. This emphasis is 
perceived to be one of the primary reasons for the success of focus visits. 

The institutional assessment used to determine which programs will receive 
focus visits begins by having each college select a focus visit coordinator. The focus 
visit coordinator is frequently a vice-president or dean of instruction. The 
coordinator's first task is to convene a focus visit committee consisting of a 
representative group of staff members. This committee could be an existing 
committee, such as a quality committee or an institutional effectiveness committee, or 
it could be an ad hoc committee created specifically for the focus visit process 
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(Grovum, 1995). It is the job of this committee to conduct the institution-wide 
assessment and recommend programs to receive focus visits. 

Each focus visit committee develops a rating system for conducting the 
institutional assessment. This system is based on data routinely collected by the 
SBTC. Although these data are collected at the state level, it is up to the individual 
technical colleges to determine which data are used and how they are weighted. 
Hence, the decisions about which programs are selected for focus visits are ultimately 
made at the local level. The data used for these decisions can be organized according 
to three somewhat overlapping categories. These categories are what the SBTC 
referred to as: (a) the mission test, (b) the efficiency test, and (c) the effectiveness 
test. 



The mission of the technical college system is to provide education for 
employment (SBTC, 1993). The mission test is an examination of the job placement 
rate of a program's graduates to determine how effectively that program is carrying 
out its mission. The SBTC established a minimum standard for placement which 
asserts that a technical college program is subject for review and possible termination 
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of state funding if placement of its graduates in related employment falls below 60% 
for two consecutive years (SBTC, 1993). 

The efficiency test consists of seven measures (SBTC, 1993). Each of these 
measures is related to how efficiently money is used to support a given technical 
college program. These measures were developed by the SBTC to provide 
accountability to the people of Minnesota for the use of their public funds for 
technical college education. The seven efficiency measures are: 

1. Number of declared majors in the program. 

2. Number of graduates per FTE (full-time equivalent). One FTE is the 
equivalent of one full-time staff member. For example, two half-time 
instructors equal one FTE. 

3. FYE (fiscal-year equivalent)/FTE ratio. This ratio produces a standardized 
figure for the program's student/teacher ratio. One FYE is the equivalent of 
one full-time student. For example, two quarter-time students and one half- 
time student who are in a program for one full academic year added together 
make one FYE. In the technical colleges, one FYE is equivalent to 45 quarter 
credits per year. 

4. Net expenditure per FYE. This figure indicates how much it costs to put one 
FYE student through the program. 

5. Number of available graduates per number of graduates. This figure 
indicates the percentage of graduates from a program who are available for 
immediate employment in their fields. Not all students who graduate from a 
program enter the job market immediately. Graduates are considered 
unavailable for employment if they are: 

a) pursuing further education, 

b) deceased, 

c) incarcerated, 

d) awaiting licensure or certification, 

e) unable to work because of a medical condition, 

f) serving in the military, 

g) engaged in personal enrichment activities, 

h) placed in unrelated work by choice, 

I) unwilling to accept employment, 

j) unwilling to relocate, or 

k) their status is unknown. 

6. Percent of graduates placed in related employment. This figure indicates the 
percentage of available graduates (as described above) who are currently working 
in positions related to their field of study. 

12 



State Council on Vocational Technical Education 



Focus Visits 



Page 7 



7. Distance to a similar program. This figure 
measures the distance to the nearest technical 
college offering a similar program. 

The effectiveness test consists of ten 
measures (SBTC, 1992). The effectiveness 
measures are related to the overall quality and 
equity of technical college programs. These 
measures were developed to fulfill the planning 
and evaluation requirements of the Carl D. 

Perkins Vocational and Applied Technology 
Education Act of 1990. Some of these measures pertain to technical colleges as a 
whole, while others pertain to individual programs within technical colleges. The 
emphasis on special populations in the effectiveness test is consistent with the goals 
and objectives of the Carl D. Perkins Act. The ten effectiveness measures are: 

1. The number and percent of students from special populations enrolled in the 
technical college. These figures are compared to regional population data to 
determine the extent to which the college is serving the special populations in its 
area. 

2. The number and percent of students from special populations enrolled by 
technical college program. Once again, these figures are compared to regional 
population data. 

3. Graduate satisfaction. A random sample of program graduates are surveyed. 
Survey participants are asked to respond to two statements using a four-point 
Likert scale ranging from strongly agree to strongly disagree. The two statements 
are: 

a) My technical college training was important for getting my job. 

b) I am satisfied with the training I received. 

The graduate satisfaction measure is calculated by dividing the number of 
respondents who strongly agreed or agreed by the total number of respondents. 
This measure is calculated for the entire technical college and for the following 
special population categories within the college: handicapped, limited English 
proficiency, minorities, and gender. 

4. Related employment and related employment by special populations. This 
measure is calculated using the following formula: 

Number of graduates in related employment 



" Focus visits have established 
Minnesota, as a leading state 
in developing efficiency and 
effectiveness measures for?: 
educational programs/f/f - * 

.Af; V-'V A v v, .\ .; 

Gene Christiaansen . < . . 

Dean of Continuing Education 
Lake Superior College 



Total number of graduates — Number of graduates unavailable for employment 

A list of the conditions used to determine unavailability for employment are listed 
under efficiency measure number five on page six. 
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5. Related employment by special populations. This measure is based on the same 
formula as effectiveness measure number four above, but is calculated for the 
following special populations: handicapped, limited English proficiency, 
minorities, and gender. 

6. Retention. Retention (or lack thereof) is measured in four different ways. These 
are: 

a) The percentage of newly enrolled students in a program who dropped out 
during the first 25% (usually 15 days) of the academic period (usually a 
quarter). 

b) The percentage of newly enrolled students who were still enrolled after the 
first 25% of the academic period, but dropped out before the end of the period. 

c) The percentage of students in a declared-major program who have not 
registered for at least one credit in their major program for two subsequent 
periods within the same fiscal year, excluding summer periods. 

d) The percentage of students in a declared-major program who have not 
registered for at least one credit during the fiscal year following the year of 
their enrollment. 

7. Occupational competencies as validated by business and industry. 

8. Graduate grades. 

9. Graduate grades by special populations. 

10. Pretest/post-test gains. Changes, if any, in academic achievement as measured by 
a standardized test. 

The mission, efficiency, and effectiveness tests are summarized in Table 1 on 
page nine. In the words of the SBTC, "The mission test determines whether we are 
doing the right things. The efficiency and effectiveness tests measure whether we are 
doing things right " (SBTC, 1993, p. 2). In addition to using these data to assess the 
mission, effectiveness, and efficiency of technical college programs for possible 
program review at the state level, the SBTC identified those programs scoring in the 
top five percent among similar programs and publicly celebrates these Blue Ribbon 
Programs. 

In conducting the institutional assessment, the focus visit committee at each 
technical college determines which measures the college will use. They also develop 
a weighted system for the measures so that a composite score can be calculated for 
each program at their college. Although each technical college has the freedom to 
develop its own unique system for assigning relative weights to the measures, it is 
important to note that within each college the same weighted system is applied to all 
programs. For example, it is acceptable that St. Cloud Technical College's weighted 
system is completely different from the system at Dakota County Technical College, 
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but it would not be acceptable for Dakota County Technical College to use one 
weighted system to evaluate one program or set of programs and a different system 
to evaluate other programs. 

Once the focus visit committee has established the system for assigning 
relative weights to the measures, they present their system to the full faculty for 
approval. Once the faculty adopts the system, composite scores reflecting the 
weighted measures are calculated for each program and the two or three programs 
with the lowest scores are selected for focus visits. 



Table 1: Summary of the Mission, Efficiency, and Effectiveness Tests 



Measure 


Mission 

Test 


Efficiency 

Test 


Effectiveness 

Test 


1. Placement rate 


V 


V 


V 


2. Placement rate for special populations 






V 


3. Number of declared majors 




V 




4. FYE/FTE ratio (student/teacher ratio) 




V 




5. Number of graduates per FTE 




V 




6. Net expenditure per FYE 




V 




7. Graduates available for employment 




/ 




8. Distance to a similar program 




V 




9. Special populations for the college 






/ 


10. Special populations for the program 






/ 


11. Graduate satisfaction 






/ 


12. Retention 






/ 


13. Occupational competencies 






/ 


14. Grades 






/ 


15. Grades for special populations 






/ 


16. Pretest/post-test gains 






/ 


TOTAL NUMBER OF MEASURES 


1 


7 


10 





During the pilot focus visit conducted at Duluth Technical College, the college 
voted to keep the selection process simple. They used just three measures to select 
the program for the first-ever focus visit and assigned the following weights to them: 
65% for placement rate, 30% for student retention, and 5% for percentage of special 
populations enrolled in the program (SBTC, 1992). In hindsight, Duluth Technical 
College concluded that assigning placement so heavy a weight was not a good idea. 
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This disproportionate weight made the impact of other measures practically 
insignificant. Today Duluth Technical College uses a total of eight measures of 
roughly equivalent weights for their institutional assessments. 

Although the institutional assessment is used to select the two or three 
programs to receive focus visits, the entire institution benefits from this process. First 
of all, the process for determining how to weight the measures gives faculty an 
opportunity to wrestle with what they value as an institution. Secondly, since 
composite scores are calculated for each program, every program receives valuable 
feedback on its strengths and weaknesses, whether or not it is selected for a focus 
visit. 

Some technical colleges, such as Dakota County Technical College, have found 
that it is insufficient to rely completely on quantitative measures for determining 
which programs should receive focus visits. For example, some programs require 
very expensive equipment, resulting in an extremely high cost per student. If net 
expenditure per FYE is assigned a heavy weight, those programs would receive 
unusually low composite scores. To compensate for the limitations of using 
quantitative measures, Dakota County Technical College has developed a two-phase 
system for selecting programs for a focus visit. The focus visit committee at Dakota 
County uses quantitative measures to identify the five to ten programs most in need 
of help. The focus visit committee then reviews each of these programs, using a 
combination of qualitative and quantitative measures as a basis for its selection of the 
two or three programs to receive focus visits. 

In at least one case, program faculty volunteered their program for a focus 
visit even though there were other programs at their technical college with lower 
composite scores on the institutional assessment. They did this because the 
instructors saw value in participating in a focus visit, and they were eager to improve 
their program. This example, along with the selection process at Dakota County 
Technical College described above, demonstrates the breadth of scope of the focus 
visit process, especially when compared to the program review model described on 
page three. Figure 2 (below) illustrates this difference in scope. 



All Technical College Programs 



Programs requiring 
a specific review 
under the program 
review model 




Blue Ribbon Programs-* • 



Lowest scores on 
the mission and 
efficiency tests 



Highest scores on 
the mission and 
efficiency tests 



Figure 2: The Scope of the Focus Visit Process 
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The intention of the program review model is to identify those programs 
which, due to their low scores on the mission and efficiency tests, need a specific 
review by the State Board of Technical Colleges to determine whether the SBTC will 
decline further state funding of these programs. Data are collected for all technical 
college programs, and each program receives feedback on its performance; however, 
onlv those programs perceived to have serious problems are subject to specific review 
by the SBTC. 

The purpose of focus visits is not to shut programs down or justify their 
termination, but to find creative ways of improving them. As a result, the focus visit 
process encompasses a broader range of programs. It is understood that even the 
best programs can be improved; therefore, every program could benefit from a focus 
visit. Yet given the resources required to conduct a focus visit, it is unrealistic to 
presume that any technical college should conduct more than two or three focus 
visits per year. Therefore, while the scope of the focus visit process is potentially 
much broader than the program review model, an effort is made to concentrate on 
the programs which need the most help and consequently could benefit most from a 
focus visit. 



Preparing for the Focus Visit 

When the focus visit selection process has been completed, tentative dates for 
each focus visit are established. Roughly 45-60 days prior to the focus visit, a 
representative from the SBTC (now MnSCU) meets with the focus visit coordinator 
and the faculty members of the program which will be receiving the focus visit. The 
purpose of this preliminary meeting is to explain the goals of focus visits and the 
processes involved in conducting them. This meeting is critical because it sets the 
tone for the focus visit and hopefully puts the faculty at ease. The meeting helps the 
faculty see that the purpose of focus visits is truly program improvement — not 
compliance monitoring. If successful, this meeting will convince faculty that the 

focus visit is intended to help maintain the 
viability of their program, not to shut it down. 

After the instructors have had an 
opportunity to discuss their questions and 
concerns and express their feelings concerning the 
focus visit goals and processes, the faculty and 
SBTC staff member begin forming the program 
improvement team that will actually conduct the 
focus visit. This team typically consists of ten to 
twenty-five members. The SBTC staff member 
helps the faculty to identify possible team 
members, but the final decisions about who will 
be invited to participate on the team are made by 



"In all honesty, I can't 
express how much our focus 
visit helped us. It helped us 
develop a plan to improve our 
enrollments. We already have 
ten people enrolled for next 
year's class. Last year at this 
time we only had three." 

Ron Furchner 
Instructor 

Body Service Educational Program 
Dakota County Technical College 
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the program faculty and the technical college's focus visit coordinator. The 
composition of a typical program improvement team is described in the next section. 



It should be noted that prior to most focus visits the interactions between 
SBTC staff, the focus visit coordinator, and the program faculty go far beyond the 
meeting described above. Before and after this meeting there are often multiple 
phone calls and personal interactions regarding the upcoming focus visit. The 
opportunity for on-going communication is vital to the success of a focus visit. In 
some cases" additional meetings are scheduled between the SBTC staff, the focus visit 
coordinator, and the program faculty. 

The Program Improvement Team 

The program improvement team for a focus visit consists of up to twenty-five 
people. This team may include: 

a) the faculty from the particular program being evaluated; 

b) up to four instructors who teach in similar programs at other institutions; 

c) the technical college's focus visit 
coordinator (usually the Vice President or 
the Dean of Instruction) as well as other 
college staff and administrators 
representing areas such as student services, 
special needs, and placement; 

d) up to four staff and/or administrators from 
other technical colleges; 

e) a staff member from the SBTC who serves 
as the moderator for the focus visit; 

f) a representative from the State Council on 
Vocational Technical Education; 

g) up to four current students; 

h) up to four recent graduates from the 
program; 

i) up to four members of the program's 
advisory committee; and 

j) up to four employers who have hired graduates from the program being 
evaluated. 

After the program faculty have identified those persons to be invited to serve 
on the program improvement team, it is typically the job of the SBTC staff member to 
actually recruit the technical college staff and administrators and the representative 
from the State Council on Vocational Technical Education. The program director at 
the technical college usually recruits the remainder of the team (i.e. students, 
instructors, advisory committee members, and employers). Once the program 
improvement team has been recruited and its composition determined, the names 
and addresses of the team members are submitted to the SBTC. Immediately, a SBTC 



"I would like to see the focus 
visit process continued 
because it's good for 
programs to have someone 
from the outside come in and 
take a look at them and offer 
some suggestions; some fresh 
ideas, and some new 
approaches." 

Bill TeVogt ■ 

Carpentry Instructor 
Hennepin Technical College 
Brooklyn Park Campus 
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staff member sends a letter of confirmation to each member of the team along with a 
packet typically containing the following: 

a) A nine page document titled Program Review Guide for Focus Visits. This guide 
describes the focus visit goals and processes and includes a form called the 
program improvement worksheet which the team members complete during 
the focus visit. Each team member is encouraged to read the Program Review 
Guide ahead of time and bring it with them to the focus visit. 

b) A roster of the program improvement team. 

c) An agenda for the focus visit. 

d) A map providing a floor plan of the building and directions to the technical 
college. 

e) Background information on the community, the technical college, the specific 
program under review, and the labor market for its graduates. 

Below are two examples of the final composition of program improvement 
teams for two focus visits. One team is relatively small, consisting of fourteen 
members. The other is unusually large, consisting of twenty-nine members. 

Northwest Technical College-Thief River Falls Campus 
Automotive Services Technology Program 
May 15-16, 1995 

2 Faculty from the Automotive Services Technology Program at the Thief River Falls 
Campus of Northwest Technical College 
1 Instructor from a similar program at a different institution 

4 Additional staff and administrators from the Thief River Falls Campus including 
the Dean of Instruction, the Student Services Coordinator, the Support Services 
Coordinator, and the Placement Specialist 
1 SBTC staff member 

1 Representative from the State Council on Vocational Technical Education 

2 Program advisory committee members 
2 Employers of program graduates 

1 Program graduate 
14 TOTAL 



Dakota County Technical College 
Autobody Repair/Body Service Educational Program 
September 27, 1995 

4 Faculty members from the Autobody Repair /Body Service Education Program at 
Dakota County Technical College 

7 Additional staff and administrators from Dakota County Technical College 

including the Dean of Instruction, the Dean of Student Services, an associate dean, 
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a counselor, a placement specialist, a recruiter, and the Communications 
Coordinator 

2 Additional staff from other technical colleges including a placement specialist and 
a recruiter 

1 SBTC staff member 

1 Representative from the State Council on Vocational Technical Education 
Instructors from similar programs at other institutions 

Program advisory committee members, four of whom are also employers of 
program graduates 

3 Current students 

4 Former students 
29 TOTAL 

Prior to the focus visit, a staff member from the SBTC assigns the members of 
the program improvement team to one of four workgroups. During the focus visit 
each workgroup examines one specific aspect of the program. One workgroup 
studies support services. Another group examines the program's curriculum and 
instruction. The third group considers the facilities and equipment, and the fourth 
workgroup looks at placement and employment of its graduates. Some members of 
the program review team are assigned to workgroups closely matching that person s 
experience or area of expertise. Others — students or local employers are often 
randomly assigned to a workgroup. In addition, the SBTC staff member selects a 
chair for each group. 



The Focus Visit 

An entire focus visit can be conducted within one eight-hour working day. 
Some focus visits are completed in as few as six hours. In other cases, the focus visit 
team meets the evening before the actual focus visit for dinner, an overview of the 

focus visit process, and a presentation of 
information on the program being examined. 
Meeting the evening before allows team members 
to get acquainted with each other and with the 
focus visit process. As a result, the team can 
begin its mission without delay when the actual 
focus visit commences the next morning . 

The format for conducting a focus visit 
varies slightly depending on whether it is 
completed in one day or begins with dinner the 
evening before. Agendas from two previous 
focus visits have been included in Appendix A. 
One agenda is from a focus visit which began 
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"What I like best about the 
focus visit process is that it- 
provides employers with an 
opportunity for input. It's 
not just a group of people 
from-the state doing a 
corrective audit." . 
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Jerry Folstrom i : 

Vice President of Operations 
Northwest Technical College 
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with dinner the evening before. The other agenda is from a focus visit which was 
completed in a single day. 

Until now, an SBTC staff member has acted as the moderator for each focus 
visit, but this need not necessarily be the case in the future. In fact, it was always the 
vision of SBTC staff that individual technical colleges would eventually accept total 
ownership of the focus visit process and begin conducting them without the 
coordination of SBTC staff. When this does occur, the technical college's focus visit 
coordinator may be a good candidate for the moderator of the focus visit. 

Although specific agendas vary from one 
focus visit to the next, the morning of a focus 
visit generally begins with a brief welcome from 
the technical college president. Following that, 
the focus visit moderator explains the overall 
purpose, as well as the undergirding philosophy 
of the focus visit process. Although this portion 
of the agenda usually takes only ten minutes to 
complete, it is crucial for establishing the tone of 
the focus visit. The moderator should emphasize 
that the focus visit is not intended to document 
all the problems and weaknesses of the program. 

Rather, the sole purpose of the focus visit is to 
find ways to make the program better. At a 
recent focus visit the moderator summarized this 
by saying: "This is not an inspection. Take off your white gloves. We are here 
today to focus all of our attention on improving the program" (Perry, 1995). 

Next, the moderator explains briefly how the particular program being 
examined was selected for a focus visit. At this point, the moderator may wish to 
explain the three criteria used for selecting programs for focus visits — the mission, 
efficiency, and effectiveness tests. Any additional issues regarding the impetus for 
the focus visit are also discussed. 

The moderator also discusses expectations regarding the final report submitted 
by the program improvement team at the end of the day. The team members are 
encouraged to focus their attention on a few major issues and not get bogged down 
with a host of secondary concerns. Consequently, the final report should be very 
succinct. 

During the next portion of the agenda, the program faculty and technical 
college administrators provide the program improvement team with important 
background information on the program being examined. The information presented 
might include data such as trends in enrollment, placement, and expenditures. It is 
critically important that the instructors and administrators have their opportunity at 
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this time to describe the problems and issues with which they feel they need help. 

This is consistent with the focus visit philosophy which assumes that the persons 
most cioseiv involved with a program are the ones most likely to understand its 
strengths and weaknesses. In contrast, inherent in the compliance monitoring 
approach used prior to focus visits was a belief that out-of-town experts were better 
qualified to evaluate the program than the people who work directly with it. This 
portion of the agenda generally takes 15 to 30 minutes. 

Following the general description of the program and discussion of possible 
issues by the staff, the moderator meets briefly with the chairs of the four 
workgroups: support services, curriculum and instruction, facilities and equipment, 
and placement and employment. The focus visit moderator and the workgroup 
chairs consider and come to an agreement on a strategy for conducting the work to 
be done by their groups. The workgroup chairs identify some critical issues that 
should be addressed in their workgroups based on the information just presented by 
the program faculty and college administrators. They are also given an opportunity 
to ask last minute questions before the workgroups convene. This part of the agenda 
takes approximately five to fifteen minutes. 

The last part of the agenda before breaking into the workgroups is a tour and 
assessment of the program's facilities. This is especially important for the team 
members who have never had an opportunity to visit the facility. This tour and 
assessment is important for framing the context of the focus visit and anchoring it to 
the real-world situation in which it exists. The tour and assessment of the facilities is 
also important because one of the workgroups will specifically consider the 
equipment and facilities of the program. It should be emphasized that the tour is not 
an inspection. The program improvement team is in no way encouraged to check for 
misplaced materials or an untidy environment. Rather team members are 
encouraged to place themselves in the shoes of the students and faculty and consider 
how the facilities and equipment enhance or inhibit learning in the program. The 
tour may take anywhere from 15 to 90 minutes depending on the program. Touring 

and assessing the facilities for an accounting 
program would probably take less time than 
touring and assessing the facilities for a 
construction program. Furthermore, some 
programs require off-site tours requiring 
transportation for the program improvement team. 

Up until this point on the agenda the 
program improvement team has been together in 
one large group; after the tour the team members 
are divided into their respective workgroups. The 
majority of the time remaining is spent working in 
these groups. The first activities of the agenda are 
important for providing background and context 



" What makes focus visits so 
successful is the fact that you 
get to talk to all people 
involved with the program. 
Without focus visits there 
will he no way to help 
improve good programs that 
are having a little trouble and 
need some advice." 

Roger Weyer 

Carpentry instructor 

St Cloud Technical College 
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for the focus visit, but it is in workgroups that the actual work of the focus visit takes 
place. Each group is given a standard list of possible issues to address (see 
Appendix B). It is not possible for any of the workgroups to address all of the issues 
on their lists. That is why the workgroup chairs are encouraged to identify the 
salient issues in advance. 

The workgroups meet twice. During the first session the workgroups focus on 
identifving the needs of the program. During the second session they focus on 
developing solutions to meet the most important of these needs. A special effort is 
made to treat all members of the group alike during these sessions. The comments of 
the group members are treated with equal respect regardless of whether they are 
students or college deans. During each session, one member of the group acts as a 
recorder. The recorder fills in a form called the Program Improvement Worksheet as 
the discussion evolves. A copy of the program improvement worksheet can be found 
in Appendix C. 

During the first session, the workgroups concentrate on identifying needs in 
their respective areas (support services, curriculum and instruction, facilities and 
equipment, or placement and employment). 

The first session takes one to one-and-one-half 
hours to complete. The second session focuses 
on developing solutions and strategies for 
meeting those needs and requires an additional 
one to one-and-one-half hours. The final 
outcome of these discussions is a program 
improvement plan which is completed bv each 
workgroup. An example of a completed 
program improvement plan can be found in 
Appendix D. 

The discussion is somewhat unstructured 
during the first session. The group chair may 
simplv launch the discussion on an issue by 
saying, "How are we doing in this area?" The second session is usually more task- 
oriented. The group chair focuses attention on the top three or four needs that were 
identified in the first session and leads the workgroup through a discussion of 
possible solutions for each need. This discussion includes developing specific 
strategies for implementing the solutions, an estimate of the cost for each solution, an 
estimate of the time needed to implement each solution, and identification of the 
most appropriatelv responsible for carrying out the solution. During the first session 
the group fills out the first column (Need) of the program improvement worksheet 
found in Appendix C. During the second session, the group fills out the other five 
columns of the program improvement worksheet (Solution, Strategy, Cost, Time, 
Responsibility). 



"I really do think that focus 
visits are a good deal, l.wish 
we would do more of them. 
They Kelp programs get better. 
The more people you, have, 
giving ideas about a program, 
the better things are going to 
be." 

Herb Rose 
Carpentry Instructor 
Alexandria Technical College 
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Another important component of the focus visit agenda is the student forum. 

The student forum often falls between the two workgroup sessions and is generally 
scheduled immediately after lunch. The entire program improvement team does not 
participate in the student forum, so scheduling it immediately after lunch gives the 
rest of the program improvement team an opportunity to visit with their fellow team 
members or take care of other business during their extended lunch break. 

All of the students who are on the program improvement team are asked to 
participate in the student forum. Additional students from the program may also be 
recruited, but the program faculty as well as the college staff and administrators do 
not participate in this part of the agenda. Likewise, the SBTC staff member generally 
does not participate. This leaves the advisory committee members, the employers, 
the out-of-town guests, and the representative of the State Council on Vocational 
Technical Education to interact with the students during the student forum. 

The purpose of the student forum is to give the students the opportunity to 
speak candidly concerning what they like and dislike about the program. The 
discussion is divided between institutional issues and issues related to the specific 

program being evaluated. The reason the college 
faculty, staff, and administrators do not participate 
in the student forum is to ensure that the students 
are not inhibited from being completely honest 
and forthright. A list of possible issues to be 
discussed in the student forum can be found in 
Appendix B. The student forum is generally given 
45 minutes of agenda time. 

Once the student forum has been conducted 
and after the workgroups have met for both of 
their sessions and have completed their program 
improvement plans, the entire program 
improvement team meets for a large-group 
discussion. Each workgroup shares the highlights 
of their program improvement plans. Members of 
the other workgroups are encouraged to respond 
and comment. There is often a great deal of synergy during the large-group session 
because of similarities between the findings of workgroups. After each workgroup 
has reported on its program improvement plan, the members of the program 
improvement team who attended the student forum report on that session. The 
large-group discussion typically receives one hour on the agenda, but can be 
shortened if the focus visit is behind schedule. 

Before the focus visit adjourns, every member of the focus visit team is asked 
to complete a one-page evaluation of the focus visit, as well as an expense report for 
any mileage and accommodation expenses incurred during the focus visit. A copy of 
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remember about the focus visit I 
attended is that we spent time 
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the form used to evaluate focus visits is included in Appendix F. The evaluations are 
a means for continuously improving the focus visit process and its effectiveness. This 
last part of the agenda normally requires only 15 minutes. 

The agenda for a typical focus visit is summarized in Table 2 on page 19. 

Please note that it is possible to conduct a focus visit in less than six hours. It is 
critical to consider carefully the needs and time constraints of the program 
improvement team while developing the agenda for a focus visit. It may be best to 
start the focus visit with lunch and finish in the evening for some program 
improvement teams. Meeting for dinner and a brief meeting the evening before a 
focus visit is generally a good idea, especially if the agenda requires more that eight 
hours, but some program improvement teams may not be able to commit that much 
time to the focus visit. No two agendas are alike. The key is to be flexible and build 
the agenda around the needs of the program improvement team. 



Table 2: Typical Focus Visit Agenda 



Agenda Item 


Minimum 

Hours 


Maximum 

Hours 


1. Welcome and overview of the process 


0.25 


0.50 


2. Presentation of program information 


0.25 


0.50 


3. Meeting with workgroup chairs 


0.10 


0.25 


4. Tour and assessment of the program facilities 


0.25 


1.50 


5. First workgroup session 


1.00 


1.50 


6. Lunch 


0.75 


0.75 


7. Student forum 


0.75 


0.75 


8. Second workgroup session 


1.00 


1.50 


9. Large-group session 


1.00 


1.00 


10. Evaluation and expense reports 


0.25 


0.25 


TOTAL 


5.85 


8.50 
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Following through with the Focus Visit 

Within two weeks following the focus visit, staff from the SBTC compile the 
information from the four workgroups and the student forum and produce a single, 
comprehensive, typewritten plan for improving the program. A draft of this program 
improvement plan is sent to each member of the program improvement team for 
review and comment. The feedback received from the team is incorporated into the 
final version of the plan. Once the program improvement plan is finalized, a staff 
member from the SBTC meets with the college president to review and discuss the 
plan. The plan is modified, if necessary, and a commitment is sought from the 
college president regarding the resources required to carry out the plan. These 
meetings are generally quite fruitful. College presidents have demonstrated high 
levels of commitment to carrying out the program improvement plans, and the needs 
identified in these plans often receive high priority during subsequent college 
planning activities (Grovum, 1995). 

Six months to one year following the focus visit, the SBTC assesses the results of 
the program improvement plan reflected by changes and improvements in the 
program. This is accomplished using a follow-up form completed by the college 
which describes the action taken thus far for each item on the program improvement 
plan. A copy of the form used for this assessment can be found in Appendix G. 

After the completed follow-up form is received by the SBTC, a staff member visits 
the school once again. In addition to discussing progress made on the program 
improvement plan, the staff member assesses the perception of college staff of how 
the focus visit affected the program — both positively and negatively. This feedback is 
also used for continuously improving the focus visit process. 

Successful follow-through is dependent on much more than just the two meetings 
mentioned above, however. The real key to successful follow-through is making sure 
that the college develops a sense of ownership regarding the program improvement 
plan. The program faculty and the college staff and administration must embrace the 
plan and be personally committed to it. Lasting change is unlikely to occur if 
accountability to the SBTC is the primary motivation behind the follow-up. A sense 
of ownership is developed throughout the focus visit process as technical colleges 
choose their own focus visit coordinators, select their own focus visit committees, 
develop their own systems for assessing their programs, select the members of their 
program improvement teams, and design their own focus visit agendas. 



Reasons for the Success of Focus Visits 

Through attendance of Council staff and Council members and interviews conducted 
during the preparation of this report, the State Council has identified at least six 
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reasons why focus visits have been so effective in improving technical college programs. 

1. The key stakeholders are involved in the focus visit process. These stakeholders 
are the ones who care most deeply about the program and best understand the 
issues regarding it. They certainly understand these local issues better than a 
panel of out-of-town experts. They are also the ones who can and will do the 
most to change the program. 

2. Focus visits create a win/win situation for all parties involved. The faculty win 
because they find new and creative ways of solving problems that could limit, or 
even shut down their program. The students win because they have an 
opportunity to voice their concerns and act as change agents in a non-threatening 
environment to help improve their program. The school as a whole also 

wins — placement specialists, recruiters, administrators, and staff from student 
services — all receive information which can help them better do their jobs. 

Finally, employers win. They have an opportunity to articulate current labor 
market needs, ensuring that the program remains relevant to their workplace. 

3. Focus visits concentrate on only a few salient issues. The program improvement 
plan is concise, can be read quickly, and can be realistically implemented. 

Themes often emerge which cut across the four workgroups and the student 
forum. These common themes form the core of the program improvement plan. 
Secondary concerns are not included in the final plan. 

4. Focus visits are non-threatening. Faculty consistently emerge from the focus visit 
process with a sense that the focus visit truly was intended to help their program, 
not threaten it. They end up seeing focus visits as an opportunity to engage in 
creative problem-solving with their most intimate stakeholders to improve their 
program in meaningful ways. 

5. Focus visits are cost effective. Because a focus visit can be conducted with a 
team as small as ten people — most of whom are from the local area — the travel, 
food, and lodging expenses for a focus visit are relatively modest. In fact, the 
average cost to the SBTC for a focus visit is less than $1,000 (SBTC, 1994). The 
technical college hosting the focus visit usually pays for the lunch and 
refreshments for the focus visit, while the SBTC covers the expenses of travel and 
overnight accommodations. 

6. The process is based on real data. The institutional assessment that precedes a 
focus visit is based on mission critical data that faculty, administrators, students, 
and employers can understand. What is gleaned from this data becomes the 
foundation of the program improvement plan. Therefore, changes in the data 
resulting from the focus visit can be quantified, and improvements in the program 
accruing from the focus visit will be evident. 
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Vision for the Future 

The vision for the future of focus visits is that technical colleges will embrace 
the process and take ownership of it. The hope is that technical colleges will 
eventually conduct focus visits completely on their own initiative, without prompting 
or assistance from MnSCU or any other state agency. Right now, only 13 of the 34 
technical college campuses in Minnesota have had the opportunity for at least one 
focus visit (Perry, 1996). While there are a few campuses that have already 
demonstrated a commitment to continuing the focus visit process on their own, most 
of the 13 campuses that have had focus visits will require further assistance and 
guidance before they are ready to conduct their own focus visits. 

It is also hoped that the spirit of process improvement which is inherent in the 
focus visit process will remain intact. Focus visits have spawned a new way of 
thinking about program evaluation. The emphasis has shifted from compliance 
monitoring to genuine concern about process improvement. As a result, there are 
cases where faculty from programs that were not struggling or in jeopardy of being 
shut down requested a focus visit because they realized it would help improve their 
programs. The imagery associated with program evaluation has shifted from a panel 
of out-of-town experts carrying clipboards and scrutinizing the faculty and facilities, 
to stakeholders who stand beside the faculty and collaborate with them to improve 
the program. The latter is refreshing, stimulating, and enjoyable. The former is 
frightening, disconcerting, and lends itself often to counterproductive behaviors. 



Recommendations 

The State Council on Vocational Technical Education, in conjunction with the 
advisory committee for this project, makes the following two recommendations 
regarding focus visits. 

1. MnSCU should continue to support the focus visit initiative. There are 21 
technical college campuses that have not yet had an opportunity to have a focus 
visit. There are other campuses who have had one or two focus visits, but need 
technical assistance, or just some encouragement, to continue the process on their 
own. Although there may be a few campuses that will never embrace the focus 
visit process, many others may embrace it if they receive continued assistance. 
Staff from MnSCU should contact each technical college campus to ascertain the 
position of these schools regarding focus visits and their interest in receiving 
technical assistance from MnSCU. 



28 



State Council on Vocational Technical Education 



Focus Visits 



Page 23 



2. As technical colleges take ownership of the focus visit process they should be 
encouraged to modify it according to their own needs. For instance, they should 
be encouraged to develop their own criteria for identifying which programs 
receive focus visits. They can continue to use the data collected routinely at the 
state level, but they should also be encouraged to collect their own data. In 
addition, they should be encouraged to determine the composition of their 
program improvement teams and establish their own agendas and follow-up 
procedures. The technical colleges would, however, be wise to consider carefully 
the activities that have worked well consistently in previous focus visits. 
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Position Statement 

Whereas the focus visit process is perceived throughout the state as a positive 
effort. 

Whereas the focus visit process is a proven tool for improvement. 

Whereas the focus visit process is implemented as a non-threatening process at 
the level closest to implementation. 

Whereas the focus visit process promotes effectiveness, benchmarking, and 
measurement. 

Whereas the focus visit process requires additional re-work for wider based 
application and acceptance. 

Therefore be it resolved that the State Council on Vocational Technical 

Education will offer its resources and expertise to MnSCU as a partner to 
initiate the re-engineering of the focus visit process into a process 
improvement model for site-based implementation. 



Signed 




Technical Education 



Dated 
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Appendix A 

Sample Agendas for Focus Visits 
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MINNESOTA STATE COLLEGES AND UNIVERSITIES 



PROGRAM REVIEW FOCUS VISIT SCHEDULE 

DAKOTA COUNTY TECHNICAL COLLEGE 
1300 EAST 145TH STREET - ROSEMOUNT, MN 55068 

AUTO BODY REPAIR AND BODY SERVICE EDUCATIONAL PROGRAM 



Wednesday. Seotember 27. 1995 


Location 


7:30 a.m. - 8:00 a.m. 


Continental Breakfast 


Rm 1-306A & B 


8:00 a.m. - 8:10 a.m. 


Welcome and Information 
David Schroeder, President 


Rm 1-306A & B 


8:10 a.m. - 8:30 a.m. 


Purpose and Expectations of Focus Visit Team 
Dayton Perry 


Rm 1-306A & B 


8:30 a.m. - 8:45 a.m. 


Program Information 
Jerry J. Johnson - Dean 
Ron McKeever - Associate Dean 
Ray Swedeen - Instructor 


Rm 1-306 A &B 


8:45 a.m. - 9:00 a.m. 


Meeting with Team Chairs 


Rm 1-306A & B 


9:00 a.m. - 9:30 a.m. 


Tour Program Facilities 
All Team Members 




9:30 a.m. - 9:45 a.m. 


BREAK 




9:45 a.m. - 10:45 a.m. 


Teams Discussion of Program Needs 


Rm 1-3 06 A & B 


10:45 a.m. - 11:30 a.m. 


Student Forum - Select Group 


Student Services 
Conference Room 


11:30 a.m. - 12:15 p.m. 


LUNCH 


Rainbow Room 


12:15 p.m. - 1:45 p.m. 


Teams Meet to Complete Program 
Improvement Plan 


Rm 1-306A&B 


1:45 p.m. - 2:45 p.m. 


Teams Share Program Needs 


Rm 1-306A& B 


2:45 p.m. - 3:00 p.m. 


Evaluation of the Process 
and Expense Reports 


Rm 1-306A & B 


3:00 p.m. 


ADJOURN 
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STATE BOARD OF TECHNICAL COLLEGES 



TECHNICAL ASSISTANCE FOCUS VISIT SCHEDULE 



NORTHWEST TECHNICAL COLLEGE-THIEF RIVER FALLS CAMPUS 
1301 Highway One East, Thief River Falls, Minnesota 56701 

218/681-5424 



Monday, May 15, 1995 

5:30 p.m. or before 
6:00 - 7:00 p.m. 



7:00 - 8:00 p.m. 



8:00 - 9:00 p.m. 

9:00 - Time Out 
Tuesday, May 16, 1995 
7:30 - 8:00 a.m. 

8:00 - 8:15 a.m. 

8:15 - 11:30 a.m. 

11:30 - 12:15 p.m. 

12:15 - 1:00 p.m. 

1 :00 - 2:30 p.m. 

2:30 - 3:30 p.m. 

3:30 - 4:00 p.m. 

4:00 p.m. 



Automotive Service Technology 



Hotel Check-In Best Western Inn 

Dinner 



Introduction & Welcome Dayton, Perry, Director MTCS 

Purpose of Focus Visit 



Process for Visitation 



Dayton Perry 
Evaluation MTCS 



Background Information College/Community Dr. Orley Gunderson 
(Region and Institution) President 



Program Information/Overview 



Norman Halsa, Instructor 
Duane Brown, Instructor 



Team Meetings, Assignments Dayton Perry, Director 

and Logistics Evaluation MTCS 



Adjournment 



Continental Breakfast 

Welcome & Comments 
Dr. Orley Gunderson, President 

Tour Program Facilities, Review 
Information and Discuss Components 
Draft Needs 

Lunch 

Student Forum 

Team Discussion of Needs 

Writing Improvement Plan 

Evaluation of the Process and Expenses 

Adjournment 



Location 
Room 131 
Room 131 

Room 131 

Cafeteria 
Room 131 
Room 131 
Room 131 
Room 131 
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Appendix B 

Lists of Potential Issues to be Discussed in the 

Workgroups 
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Support Services Team 

This team is charged with reviewing the student opinion survey regarding 
Support Services, interviewing students enrolled in the program and 
discussing/documenting potential issues in which services might be improved. 

Discussion issues might include: 

• Admission 

• Recruiting and marketing strategies 

• Brochures and application forms 

• Counseling and advising procedures 

• Assessment/testing, counseling and placement recommendations 

• Student information and orientation 

• Financial Aid and work/study 

• Career planning assistance, scheduling, electives 

• Remedial assistance 

• Support groups 

• Housing and child care 

• Personal counseling and students assigned 

• public agency assistance and referral 

• Attendance policy and grade point average 

• Transportation 

• Student Senate 

• Records required for admission, transfers, graduation 

• Student assessment/feedback about services 

• Student expectation, policies and conduct 

• Advocacy for students’ rights 

• Retention strategies/procedures 

• Health insurance, safety 

• Grievance procedures 

• Other services (fees, placement procedures, follow-up, image, transcripts) 



0 



State Council on Vocational Technical Education 



Page 32 



Focus Visits 



Curricuium/lnstruction Team 



This team will focus on curriculum content and its relevancy to current technical 
training and education and labor market needs. 

Discussion issues and opportunities for improvement might include: 

• Curriculum guide 

• Course syllabus 

• Goals and objectives 

• Grading procedures 

• Curriculum modifications process 

• General education requirements 

• Technical and remedial courses 

• Instructional aides > computers, overheads, etc. 

• Tutorial assistance 

• Course sequence 

• Availability of courses 

• Curriculum evaluation/validation 

• Credentialing/certification of staff 

• Students’ opinions of instruction 

• Employers’ opinions of graduates 

• Advisory committee input 

• Program awards or recognition 

• Internship or clinical documentation 

• Instructor upgrading 

• Guest instructors, field trips 

• Shadowing or mentoring 

• Student assessment/testing/outplacement/transfer 

• Professional/business/trade journals and publications 

36 
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Facilities/Eauipment Team 

The facilities team will focus its effort on appropriate equipment and facilities that 
enhance learning and model the business community. 

Discussion issues might include: 

• Program area promotes learning 

• Standard equipment for instruction 

• Comparable to industry standards 

• Rental or lease program for equipment 

• Replacement schedule for equipment 

• Using advisory committee recommendations 

• Consistence with curriculum and instruction 

• Area is sufficient for the number of students (classroom and lab) 

• Maintenance plan for equipment 

• Appropriate facilities and equipment for students enrolled 

• Safety and security procedures 

• Classroom and/or lab - space and decor 

• Disposal and storage space 

• Employers’ donations to the program 

• Heating and lighting 
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Focus Visits 



Placement/Emplovment Team 



This team will focus on placement procedures, employment opportunities and 
potential employers. 



Discussion issues might include: 






Student expectations 
Staff expectations and responsibilities 
Placement office assistance and procedures 
Information students receive on: wages 

labor market outlook 

potential employers 

previous graduate class placement 



Resume and interview techniques 

Early notification of potential employers 

Advisory committee role in placement and labor market 

Labor market demand 

Number of potential employers 

Willingness of students to relocate 

Employer contact with instructor concerning needed qualifications 
Employer contact with instructor concerning job openings 
Reporting student placement 
Employer assessment of graduate performance 
Job development procedures 
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Student Forum Format 



Purpose: 

To obtain feedback from students as to what they like about the college/program and 
identify areas that can be improved. 

• Ask students to introduce themselves and state one reason for attending 
the college. 

• Ask the students to state some of the positive things they like about the 
program. 

• Ask the students to state some of the areas in which the program could be 
improved. 

Optional Discussion Items: 



Institutional 

■ Child Care 

■ Housing 

■ Registration 

■ Course Information 

■ Program Offering at Convenient 
Times 

■ Evening or Weekend Classes 

■ Counseling 

■ Information 

■ Safety 

■ Car Starting 

■ Emergency Funding Source 

■ Agency Service 

■ Access to Administration 

■ Climate (not temperature) 

■ Harassment 

■ Tutorial Assistance 

■ Library 

■ Equipment 

■ Grading 

■ Placement 

■ sports Activities 

■ Parking 

■ Smoking 

■ Food Services 

■ Help 

■ Transportation 

■ Placement/ Information Assistance 

■ Tutorial Assistance 



Program 

■ Course Requirements/Information 

■ Assignments or Expectations 

■ Course Content/Sequence 

■ Instructional Delivery Methods 

■ Grading for Projects/Performance 

■ Attendance 

■ Verbal or Written Assignments 

■ Equipment/Tools 

■ Advising 

■ classroom Environment 

■ Availability of Instructor(s) 

■ Diversity of Students 

■ Testing/Assessment 

■ Student Respect 

■ Concern with Problems or 
Performance 

■ Time Courses Offered 

■ Employment Outlook and 
Assistance 

■ Internship or Clinical Experience 

■ Clothing 

■ Orientation/Information about 
Program Requirements 

■ Make-ups for Tests and Exams 

■ Lab time and Lab Costs 

■ Project Assignment 

■ Study Groups 

■ Employer Expectations and 
Conduct 
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Appendix C 

Blank Program Improvement Worksheet 
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Appendix D 

Sample of a Completed Program Improvement 

Worksheet 
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Appendix E 

Sample of a Finished Program Improvement Plan 
(A compilation of the program improvement 
worksheets from each of the workgroups) 



State Council on Vocational Technical Education 

■ 0 , 40 



3 

in 

i 

ON 



z 

< 

J 

Cm 



.8 



4> 

4> 
fa* 

<55 

u 

« 

T3 
4) 

CJ 2 

o S 

in 

m — . 

ei 2 >* 

.s » ea 

S 3 < 

“ § §= 

£ c 2 

n .= 3 

g.S S 

cn - 



hi a 



£ 

o 

CO 

0) 

c 

c 



O «j 

'cl “ 
eg • 
CJ 03 



o 

ERIC 



Tf 

ON 

©\ 



CO 



u 

a 



VJ 

> 

w- 

O 

© 

13 

Q 



c 

.2 

*o 

'E 

1 

H 

e 

© 

E 

Q* 

‘5 

c 

W 

13 

# © 

*■5 e 

© g 

S -2 

i 3 

O © 

5 T 



E a 

3 

u 

OJD 

O 

u 

0* 



CJ 

tf 

’o 

CJ 

1 

E 

1 

H 

8 

> 



u 

O V) 

Z 3 
^ a 

E 

i « 

'U 



a 



o 

U 



8 

.2 

eg 

13 >4 

u ^ 

1 ’ 5 
b 13 
H Q 



c 

o 

8 

© 

■o 

CJ 

Cm 

© 

eg 

Q 



u 

CJ 

OJD 

'© 

% 

"o 

CO 

i 

u 

'3 

E 

X 

o 



eg 

u 

o 

.3 

CJ 

a 

eg' 

u 

u 

eg 

2? 

tA 



3 

C* 

•o 

s 



■o 

CJ 



8 

g 

3 



CJ 

u 

15 

a 

u 

CJ 

£ 

o 

E 

eg 

H 



2 

o 

a 

8 

tf 



vj 

O 

CJ 



>3 

13 

u 

35 



o 

<>3 



■a 

s 

z 



u 

© 

13 

3 



© ^ 
& ON 
C /3 ^ 



in 

<s 






-o 

CJ 

u 

o 

u 

a 

OJD 

C 

2 

3 



8 



3 

u 

o 

a 

u 

s 



-Se 

& tj 5 

O C 3 

3 m U 

U 
u 
3 

CJ 



CJ 

8 8 

Q u 

. 3 



SP 

cj .5 

s := 

a -3 

X L. 

« CJ 

-o >> 

c ,2 

3 Q, 

CJ E 
- 8 
3 V) _ 

"E § "2 

CJ -g CJ 

0 = 2 
H vi a 



8 

u 



© 

c 



« 8 

3 <*» 

o S £ 
& E -2 

O >» 3 
© O © 

® &’E 

j i s 



u 

© 

cJ 

3 

U 



Jf* 

a on 

CO T-H 



o 

<S 

N 



</3 a 
< 2 
LT 2 

Cs3 .a 

« E 

C/3 § 
£ 2 
CJ ■< 

£ ea 
c u 

CJ 5 

vj z 

CO g 
i 3 



■o 

3 

3 

a 

cj cj 

•1 = 

Jr o 

£ 8 

a © 

rE 13 

*% 

2 | o 

CJ CJ 2 

■S 3 I 

i-la 

S £.S 



2 q. 

3 -3 

J e 

V) QJ 

S 1 

li 






o « 

O -o 

cj — 
"S — 
o 
CO 



-3 

CJ 

s 

o 



tfsg 

■o b 

CJ £ 

ri 5 



b 

H 

H — 

B.S 

2 S 



3 

3 — * 

= W 3 

ca u .r 

cj a 

E C/) 

o 

t < as 

CJ *0 (ton c /5 

CJ 3 O g 

j- w 8 

^ y u .S 



3 

U 



U 

o 



o .3 



C/) 






U gJO 

o 3 

CA Ed 



8 



= i 

ir 

It 
a 5 



3 

O 

OJD 


>> 

u 




3 


3 


3 


CJ 

3 


;► 

£ 


O 


“cj 


CJ 


u 




u 


"a 

3 


c£ 




3 

CJ 


.2 


E 


> 


CJ 


CJ 

& 


3 


1 


VI 



C/) 

2 

s 

CJ 

> V) 

I! 

<3 u 

CJ Q, 
CJ 

-3 3 

^ CJ 

</) e 

S I 



3 

8 .2 

3 

CJ i u 

13 2 a 

^*3 © 

® 3 g 

*3 3 3 
3=3 
3 >» 3 
^ V) gp 

1 3 3 
’? .2 M 
£ S u 

. 8 8 

eo 2 



8 

> -g 
< w 

ii , 

1 u 

2 CJ In 



3 

3 

U in 

•9 ^ 

« On 

a ^ 



§ 

8 



g 2 

.2 qj 
> ^2 
^3 3 

< i 

£ E 

*2 cj 
^ cj 



•o 

3 

3 



3 

CJ 

-3 



™ 3 
J5 .2 

I 2 



i 1 


a * 

VJ 


V) 

V) 


5 


3 


.2 E 


3 S 


3 


E 


*3 


« i 


.a E 


CJ 


E 


3 


«3 


91 


5 

1 


o 

CJ 


O 

i 



C/3 

8 

3 

CJ 



•- O .2 



3 

O 



CJ 3 2 

&s -5 

« a g 

a &Sfc 
J i J 
I'ft 

2 u a 

« a. a 

■° -o « 

5 §.s 



•o .S 

sa 

*s qj - ^ 

2 |s 

1 1 i 1 1 

3 < cj < cj 



Tf 

ON 

ON 



a 



r- 



8 

> 

T3 

< 



E ^ 

o £ 

£ _o 



-2 g- 

3 S 

^ ^ © 
= -0*0 
•- aj CJ 3 

3 
CJ 
•D 
3 

V) 



u 

£ 

VI 

3 *g 
cj 3 
“D 3 
3 

v! ^ 

CJ u 
u 3 
3 3 

a 

CJ^QJ 

a. 

2 a. 

i I 



U 

CJ 

a 

3 

a 

S2 

>> 

"E. 

£ 

« Ofi 

u s 

.a -a 
£ a 
Is o 

£ a 



CJ 


CJ 


V) 










3 


CJ 

3 


o 


3 

E 

3 

L- 




VJ 

3 

CJ 


*o 

3 

3 


u 

© 

c 

CJ 


“vj 

3 

u 

CJ 


J3 

*3 


V) 

a 


OD 

O 


CJ 

8 


t3 

3 


_VJ 


a 

3 


g 


> 

CJ 

S 

CJ 


s 

CJ 

.2 

u 


u 

a 

3 

0 m 


3 

O 

CJ 

*o 


In 

CJ 

CJ 

3 


1 

VJ 

& 


a 

2 


u 

«2 

■© 




a 


r/s 


CJ 


3 


CJ 


3 


© 


CJ 

Pi 


o 

u 

a 

a 


8 

u 

£ 

•g 


u 

"S 

= 

CJ 


"E 

a 


> 

u 

3 

g 


© 

u 

o 

•3 


u 

*3 

= 

© 




3 




u 


in 




VJ 


u 



Tf 



IOC & 8 



o 

40 



£ 

0 

tn 

>. 

CO 

CD 

cn 

o 

o 

O 

co 

0 

1 

U 

CO 

o 

0 

c 

c 



ERiC 



£3 

U 

to 



cn 



r- 

Cn 

fS 



2s < 

o )& ST 

in t— 

dS > 

‘■5 

.*= 3 



E * 



vi 



I s 

5-S ^ 



cn * 



3 C3 

-Q.fi- 

C5 ’ 

O cn 



Tt 

On 

On 



ro 



u 

a. 

< 



cn 

> 

O 

CJ 

3 

a 



c 

.2 

*3 

‘5 

-c 

a 

H 

c 

CJ 

£ 

a. 

‘3 
c r 

*3 

u 

’"5 p 

<u c 

§ = 

1 s 

5 E 

£ U 

3 

U 

&D 

O 

U 

&4 



CJ 

J? 

o 

■« 

u 



u 

« 

H 

8 

? 

1 S 

z s. 

o | 

tfu 

o 8 
O .* 
a 

s i 

S © 

"3 * 

H Q 



c 

o 

2 

(U 

"O 

CJ 

P, 

a> 

> 

a 

a 



u 

CJ 

&D 

• M 

CJ 

* 

■C 

cj 

cn 

sL 

.2 

‘3 

£ 

X 

o 

S 



3 

u 

o 

-Q 

CJ 

Q 

ef 

u 

u 

a 

tf 

cn 



3 

£ 

#s 

■o 

c 

J3 

2 

CJ 



2 

£ 

3 



2 

S 

CJ 

u 

■o 

o 

a 

u 

CJ 

.3 

o 

Pi 

£ 

S 

H 



■Q 

1 

O 

a. 

Sfl 

0$ 



>N 

3 

u 

33 



~ u 
c o 

CJ * 

2 3 

2 b 

£ a 

CJ 

S = 

> 3 



Tf 

8 



3 



3 -* 

S « 

Oj co 

« i 

£ E 

tf 

< £ 

CJ 

1 £ 



y « 



•O 

-3 

3 

e 

'3 

2 

O 



-« 8 



CJ 

• cn 



2 £ 



1 1 

b u 



u 

3 

0 

>> 

■o 

CJ c 

u o 



3 

3. 

CJ 


2 

cn 




u 

£ 




u 

a. 


u 

a 


cn 


CJ 






<3 


C 


u 


cn 


u 




o 


3 


> 


CJ 

2 


cn 

2 


£ 


Q. 

CJ 

u 


CJ 

’> 




w 

■o 


.2° 


Q- 


La 

CJ 


o 


3 


"35 


o 




H 


q5 


cn 

3 


H 


.£ 



o 

>> 



- aD 
3 e 

1 | 

- 2 

cj is 

V5 W 

C cn 

2 £ a 

dx) 2 ■© 
e « 3 
2 Q. cn 

♦N La • 

“ « M 
• g CJ 

VO .3 >> 



"O 

£ c 

O CJ 

- *2 
J* O 8 
c a £ 

CJ 3 » 

■o i « 
3 « .2 

M .5 > 



E 

£ 

o 

_ u 

*E 8 

2 1 

i a 3 

h C Cfl 

- i -o 

g £ « 

4i c — 

■o CD Q. 

■“ *3! 5" 

cc g < 

i 3 i 



>% 
m £ C 

’55 5 

a e 

o o 
~ « c 
ax o 
c 

'3 3 

"5 £ 
h u 
2 8 £ 

.£ e 

3 

cn o 

Ip 

. 3 3 
1"^ cn £> 



8 

U 

3 

■o 

CJ 

CJ 

O 



cn 

2 

3 



0*2 






E 

CD 

C/5 

>V 

CD 

CD 

O) 

0) 

O 

o 

03 

o 

'c 

SI 

.8 



13 

00 ri 
b o' 

« N 

<d cr 

u - 



z 
< 
VO J 

o S « 
W *** 
in _ 

•> e ^ 

es — ** 

.s cs; 
| 2< 
“11 
111 
g-S c/3 
00 - 



liJ il 



03 

o 

CO 

0) 

c 

c 



2 « 
•1“ 
3 W 

U co 



er|c 



Tf 

I 

ro 



© 

& 

< 



CO 

■> 

(M 

O 

© 

3 

a 



s 

.2 

o 

"£ 

j: 

8 

H 

s 

© 

£ 

a. 

’£ 

a* 

W 

"3 

© 



■« 8 



S .2 s- 



o — 

5 3 

£ * 

2 

wo 

o 

© 

On 



© 

"3 

U 

"3 

© 

’£ 

.s 

H 

8 



to 

5 3 

2 a. 

3 5 

S?u 



o 

U 

"3 

© 

"£ 

.s 

8 

H 



2 

3 

J* 



o 

u 

© 

a 



s 

© 

H 

s 

© 

UJ 



a 

CL 



J= 

On 

#v 

3 

O 

CO 



& 



© 

© 

B CO 

'3 

© 

> 

© 

(55 

c 

o 

CO 

*£ 

65 

On 

© 

3 

JZ 

U 



o 

a. 

8 

C6 



CO 

O 

u 



>> 

&o 

Sr 

3 

© 

(35 



o 



« 

8 

z 



o 

co 

> "3 
■o S c 
*< rt .2 

s si 

1 1 3 

| s i 

33? 



"© 




® 3 

Sfi EL 
> s 
■o — 



4> 8 
(/) ^ «« 2“ 

* f» 8 -a 



■g 5 a E 

C S a * c 

3 8 «j o 

®r °? °f v 



3 

= = 

O .S 

WO © c 

.5 « - 

C "O "O 

• « I OJ 

2 T 3 

a . _ 

e I 

5 £ .& 

2 §■ 

3 CJ 



© 

© 

3 

a 



o 

H 



3 

m U 

"O "5 
C © 
3 5 



c 

o 



65 

© 

c ~ 

© 3 

WO V 

CL "O £ 
C CL 
© *3 

8 §• 
co © 



3 

© 

© 

© 



© 



© 

© 



2 

1 



"© 

3 

© 



© 

‘-5 



*§J 



® *s ° 

*r* S #s 

•5 S e (• 

< .So 
.. 8 2 & 
■3 S 5 -a 
« E<a S 
£ £ £ *S 
-® © « © 
Vu s E 



© 

3: «2 

■t; © 

S 'S 
© 



3 

© 

■© 

3 © 



co 



CO 

U i* y 1 

■o •= .S 

’I § § 

2t ft 

r a -a 

© CL q 

H © - 2 , 



u 

3 

© 

-3 



© 



© 

© 

65 

ts 

© 

-© 



g 

E 

a, ^ 

’£ © 

C N 

— "3 



|.| 2 I 

£ T3 « ns 

N I » S 



3 

© 

« 

u 

lo 

.£ 

£ 

■© 



5 

(/3 

< 



ss 

fS fO 



© 

co 

2 

"© 

u 



■© 

3 

* 

•3 8 

© £ 
.^© 3 

3 3 

-O © 

2 .£ 

© 2 

H 3 



■© 

u 

e5 

© 

£ © 



_> « 

= ^ 

* « 

■8 £ s 

-H co 

On -O 2 

- s J2 

n e5 © 



3 

O 

3 

u 

3 

3 

£ 

■o 



c« 



VJ* 



3 

© 



© 

U 



©* 

© 

u 



</) 

o 



© 

© 



>% 

© 



CO 

© 

© 

3 C 

2 .2 

"© 5 

© *3 



© 

H 



© 

>1 

© 

w 3 
© .2 
-a 3 



© h 
-a S 

• mm 



> 

© 

u 

On 



3 

© 

3 

© 

2 

3 

£ 

■a 



cn 

< 



* o 

X 2 

xn « 
t- u 

pm © 

V5- CL 



© 

CO 



3 

© 

© 

3 



© 

© 

33 

© 



3 

W 



© 
c2 
JO 

3 
© 

3 

> 

•<»* 

© 

© 8 
CO 

2 "3 

-3 c 

H © 

3 -a 

ft- S 
• © 
in s 



OJ 

kTj 



C. 



in 



E 

Q) 

to 

>v 

CO 



(D 

cn 

0 ) 

o 

O 



ctf 

0 

1 

il 



03 

O 

CO 

0 ) 

c 

c 





10 ) 



CO 

IO 






E 

CD 

to 

>V 

CD 

CD 

CD 

0 

o 

O 

03 

0 

1 

if 

03 

O 

C/S 

0 

c 

c 



*3 

h 8 

u e\ 

-g ^ Z 

U2 j 

oS£ 

lO "■* 
IS) _ 

* ® ^ 
00 — w* 
C V) V 

!•:“ 

5 o ^ 

" c 2 
a.5 3 
g.S Cfl 

c/j - 

2 i 
■ta- 
ts 

CJ C/3 



er|c 



Tt 

£ 

c\ 

rTi 



u 

& 

< 



V) 

> 

o 

£ 

Z 

a 



c 

.2 

‘3 

‘2 

1 

s 

2 

3 

‘5 

a- 

fa 

8 <C 
*-5 .a 

cj > 
S cj 
£ « 

5 u 
o 

^ a 

c a. 

3 3 
*- 03 
0JD 
O 
u 

fa 



a> 

Jp 

o 

U 



cj 

CJ 

H 

8 

& 

tm 

TZ 

O vs 

Z 3 

.. g 

&o 

31 

3 J 

CJ _ 

Is 

Si 



3 

o 

o 

£ 

c 

c 

< 



c 

2 

"vs 

fa 

a 

> 

a 

8 

ca 

2 

3 



CJ 

V) 

O 

U 

.* 

b 

u 

3 

Q 



cj 

co 






CO 
♦ •- 
E 

3 

CJ 

H 



a 

o 

a. 

8 

fa 



vs 

O 

U 



CO 



O 

05 



49 

8 

2 



8 

> 

u 

a> 

CO 

§ 

3 

3 

5 



u 

CJ 



f 3 

3 ON 

CO »H 



CJ 

c 

o 

2 



c: ^ 

3 O 



vs 



SC <2 
1 43 

s 

0) 

s- 



CJ 

vs 



3 

CJ 

3 

3 



vs 



3 

CJ ^ 

U >5 

u .t: 

= ."3 

i H -s 

£ o 3 
c -a > 

M S3 3 



CJ 

.fi 0) 

5l 

■3 1 
33 w 

3 -Q 

S*8 

•| § & 

£ ■§ - 

Ip 

Z 175 S 



8=1 

151 

«5 « (8 

Q. = . 2 , 

4> S T* 

*o g o 
1 2 "*"* 
.Sow 
« ° .2 
g 8 .2 

5.2 2 

• 3 CJ 
3 £b 



u 

O 

O 

3 

La 



3 

.2 

Z 

u 

vs 

‘2 

'£ 

T3 

< 



1 * 

| = 

3i! 3 

co fa 



CJ 

3 

O 

2 



.2 

u 

3 

> 



O 
vs 

3 ■- 

1-5 

.1 ^ 
'u 

® « 
8 55 



& - 



e 

£ 3 

8 S 



a r; « jb .§ 

fe t a. 8 .3 

5 -§i| 

« o o 

e: a 

^ o 

=3 3 "O 
3 O « 

fa 2 cS 
y-s cj "S 

£ 3 b 



> 

u 

CJ 

vs 



3 

f 8 

CJ j- 
CJ 3 3 

> “ - 

fl 

s 



c 2 



o = 

£ S 

cj o 

aU 



£ S 

I « 

VS CJ 

t3 .a 

£ £ 
3 CJ 
O vj 

0 <u 
CJ -3 
U 

1 .2 

CJ 

CJ ^ 

^ a 
« o 

S SL 



vs 

3 

O 

3 3 
CS VS 

JZ O 
.a - a. 

O La »Q 

7 a S 

• s O g 

3 jg 'U 

u .2 o 

:h 

Sri 

sal 

• CbJS 
n o = 



2 

e CJ 

’> 

La 

CJ 

CO 

3 

CJ 

"O 

3 

33 



■o 

= 8 

.2 > 

m U 

« CJ 

h co 

VI ^ 

1 s 
ii 

< co 



CJ 

2 




■SI 

OS 


On 


XI 

OS 


XT XT 

On On 


XT 

OS 




On 


On 


On 


o\ 0\ 


0\ 














s 


$ 


mm 


M 


— 


m mm 


MM 


3 


3 


z 


z 


z z 


Z 


CO 




fa 


fa 


fa 


fa fa 


fa 



CJ 

3 

O 

2 



CJ 

3 

O 

2 



3 

CJ 

"O 

3 

vs 



> CS 
vs 'SS 

5 8 

VS CJ 



Q > 

La 

o « 

3 vs 



S 8 

§• 3 
es .2 

&X) Z 

J 2 

"3 CJ 
3 3 
3 CJ 
&£ 
La 

CJ La 
2 «2 
a a 

o « 
u g 

S' S 



■o 

0) CJ 

A 13 

si 

■3 3? 

8 = 

3 3 

>> -o 

CJ CJ 

Sg & 

P CJ w. 

*- ■> « 
/— n cj 23 
3 La vs 



CJ 

u 

"3 -a 

CJ CJ 

8 5 

La La 

£b 3 

cj "3 

a oj 

3 -® 

.2 5 

n vs 

C5 “3 
. 8 
3 



Sfi 

CJ 

• at 
> 
La 

CJ 

CO 



8 

•2 

*> 

La 

CJ 

CO 



vs 

s 

"O 

8 2 
u </} 

E 2 



CO 

LO 



e 

0 

1 



w vs i£ 2 VS VS 

3 3 3 *3 g ‘S 

CJ CJ CJ 3 .3 *s 



3 

CJ 

■3 

3 

53 



3 

CJ 

3 

3 

5 



3 3 ’> £ 

= c fc 3 
« ■- CJ T 

CO fa CO < 



CJ 

3 

O 

2 



CJ CJ CJ 

3 S3 

o o o 

2 Z 2 



CJ 

Z 

.2 

b 

3 

> 



3 

CJ 

N 

‘2 

3 

O 

CJ 

u 

o 

2 



La 

o 



CJ 

a 

3 

CL 

3 

O 



CJ 

3 



3 

3 .£ 



o 



§. 8? 

r'os 



w4 CJ fS 



La 

CUD 

.2 « 

o ^ 
o o 

u ^ 

s 



3 

I c 

vs 

8 ® 
cj 2 : 

£ ® 

CJ 

8 5 
t >, 



o 

3 

z 



b 

‘3 



8 

a* 

3 

J 



8 

vs 



■fi Tt 



o rz 
U ^ G 
8 3 w 

o i«a n 

Tf CL 3 IO 



OJO 

.2 
■o 

2 s 

s £ 

! i 

3 O 



CUD 
CJ 3 

> — 
3 O 

£ 8 . 

« 8 
cj cj 

8 . 2 . 

E « 

15 £ 

3 cj 

vs 

O >> 
o vs 

G -a 

^ 3 
3 3 



u o 

O 3 

1 = 

o cs 

3 vs 
3 — 



CJ 

3 



■8 

8 

s 



iJO 



u se 
8.2 

i ® 

3 CJ 

Li La 

. 8 
Tf >» 



— 3 

£ > 

8 | 

i e 



00 



£ 

0) 

To 

>v 

C/D 

CD 

O) 

0) 

o 

o 

03 

o 

'c 



£ 

iml 

(0 
-4— » 

o 

CO 

CD 

C 

c 





— & M z 



£ 

Ami 

CO 

o 

C /3 

0) 

c 

c 



13 

2 . <N 

55 J 2 

tf 5 <N 

«ss 3 

o ^S- * 

in 

in _ 

* o ^ 

W) — ^ 

111 
5 o 2 
a S $ 

£ c 2 

5^3 
5-2 <n 

Cn _* 

2 « 

’S> 

a • 

CJ cn 



o 

ERIC 



Tt 

& 

«\ 

m 



u 

a. 

< 



V) 

> 

<*- 

O 

CJ 

3 

Q 



s 

.5 

*C 

*E 

1 

H 

s 

CJ 

£ 

a 

5* 

a 

*3 

*"3 _ 

CJ ~ 

S 5 

t S 

.2 cj 
ca ° 

w 3 



s 

& 

u 

& 



* § 

1 

O 

>—> 

3 

Cn 

jiT 

o 

"5 

cn 



cj 

J 1 

o 

U 

*3 

cj 



£ 

H 

8 

> 



o 

CJ 

cn 

G. 

<— * 

57 

u 

o 

VI 

"u 

3 



I 52 1 

Z G cj 
ST 3 
• • *- r" 

CJ 



g»i 



■u 1 

SS CJ 

O 8 Cfl 

Ui c 
- *3 o 
2 ~ 

1 ‘3 S 

-C u — 
^2 
E- Q E- 



.c 

1 

O 

a 

8 

fifi 



VI 

o 

U 



>» 

tf 

3 

u 

55 



o 

cn 



VI 

-a 

s 

Z 



<u 

-a 

8 

U 

Cn 

•a 

c 

3 

fa 

u 



Tt 

a 



3 

fa 



cj 

s 

o 

Z 



CJ 



CJ ~ 

E = 

t<2 



s 

cj 

-a 

3 

jK 



u 

3 

a. 



o 33 



cj 

3 

•a 
o 

c S ®- a 

1 •- If J 

u II s 



u 

£ 

8 



s 

3 

u 

o 

a. 

a. 

o 

CJ 

h w 

2 I 

<U -3 

O 3 

H vi 



>, 8 

c u -a 

r f s 

a s a 

s s .2 

113 

Soy 

^ u Q. ® 

..28* 

nh a. u oj 



u 

3 



-o 

s 

3 

V) 

8 

V) 



3 

cj 

£ 

<D 

CJ 

3 



S» 

.5 in 

A* 

cn 



in 

rf 

*9- 



.2 cj 

VI 

si 



0) 

vi 

3 

.3 



CJ 

3 

O 

3 

O 



3 

3 S 

T3 85 

d ; h 

r o. o 

« s u 

-c ffl >> 

cn 3 .c 



u 

£ 

u 

0) 

>» 

o 



VI 

3 



<U 

-o 

3 5 

g-^ 

a tn 



3 

<U CJ 

a i 

« ^ 

3 *<5 

*3 3 

b 2 
^ o 2 
•5 ^ 

9" "o 5^ 
g 0) o 

w-o a 

. 8 g 

fS 3 0) 



u 

o 

o 

3 

u 



<U 

3 

O 

z 



42 -8 

g 3 

1 8 

3 -s 

w <U 
4) -3 

^ s 

3 vi 

S Vl 

O 

u O. 

o Cfa* 

tJ ° 

2 | 

a | 

NN 3 



3 

O 

>> 

<y 

3 CJ 
vi ja 

o 

S cj 

® -a ^ 

a. « 5 

E I SP 
w J= i 

• o f 

fO — ^ V3 



8 



U 

O 

O 

3 

u 



in 

<n- 



VI 

S 

£ 2 « 

1 |1 

u 2 s 

0 *3 CJ 
45 Q. VI 

= -•§ 
h -V ■% 

2 •> -a 

3 

0) 3 3 

■5 s „ 

3 o u 

1 22 

c a x 



VI 

VI 

cz 

u 

T3 

g a 

;! 

cj a 

E >* 

1 I 
$ 2 
^ u 
3 3 

o ^ 



•— CJ 

3 •« 



•3 

CJ 

13 

u 

3 



^ 2 “ 
& -a *3 

MS 
>* c 
.3 vi 



3 3 
CJ CJ 

"3 



^ vi 3 



u 

o 

u 

3 

u 



I 



a 



CJ 

3 

O 

z 



3 

O 

CJ >» 

a® 

.2 « 

LI 

X 3 

* i 

■S3 e 

— c a 

« § « 

s E v 

*0 c 

a .» b 

-sac 

cn 3 3 



"3 

3 

3 

cj .y 
5 3 u 
8 2 
S a 



CJ 

vi 

*2 ^ 
§3-0 

s -= g 

s * 
O 3 



CJ 

-3 



‘1 a -I 

5 -a 2 

“ Q. CJ 

O S.S 3 

H J3 ■o 



0 c 

1 .2 

> a 
o .2 
C a 

n n 

| o 

2 1 
fa 3 



.2 

3 

*3 

3 

3 



O 

O 

U 

Vl 

vi 

3 

“ 8 

§ s 

§ U 

^ s 

G> 

JJ X 

^ CJ 



u 

CJ 

CJ 

13 



3 

CJ 

£ 

CJ 

CJ 

3 



u 

CJ 



.= ^ 



CJ 

3 

O 

Z 



2 

CJ 

a. 

£ 

CJ 

u 

*2 

CJ 

II 

Is 

< a 



CJ CJ 

>> ± 

0 C 5 

0,8 

3^3 

CJ O O 
w. — **3 
0^3 

"33 S w 

1 8 I 

fa a. £ 



VI 

3 

u CJ 
CJ "3 
>% 3 
-2 « 

£ S 

CJ c 
CJ o 

-3 *3 

> 2 

I g 

fa o 

'c !e 



3 

CJ 

■ •3 

8 

fa 

CJ 

CJ 



u 

CJ 



3 2 

58 



§ 

in 

* 9 * 



1 - 1 

fc 42 

3 3 
u cj 

— -3 
■3 3 

C oS 

^ «- 



t £ 
> « 
u 3 
3 3 

cn a. 



2 ^ 

— 3 CJ 



CJ 

3 >> 
O "3 

■3 g 
3 u 

* 3 

"3 I 

u 3 
3 O 
O O 
«- 

VI 

> VI 

l-S 



■a 

u 

3 

O 

> 

CJ 

Q- 

3 



vi 

O 

& 



3 

O 

■® «. 
JZ oo 

VI 3 

3 *E 

"S cj 

2 a 



(2 



o 



C 5 

L 5 



£LQ 



£ 




aj 




00 




>V 




C/3 


■w 

flj 


CD 


<u 

u 


cn 


55 


a> 


u 

« 


■■ * ■ 


T5 


o 


Q 

u 


a 


o 

in 


■MB 


m 


03 




CJ 


.£ 


c 


w 


J c 


£ 




£ 


|£ fij 


F 


§.S 03 


in\i 

03 


03 

.1 J 

‘5. “ 
01 * 


O 


U cn 


CO 




a) 




c 




c 





o 

ERIC 



5 

OS 

co' 



u 

Q. 

< 



C/5 

> 

O 

<u 

fi 



c 

.5 

u 

‘5 

JS 

& 

H 

c 

OJ 

E 

a. 

‘5 
a r 
W 

13 

# cj 

•3 _ 

S s 

I s 

.2 S 

w O 



C3 

u 

OX 

o 



a 

OX 

a 

o 

a 

13 

CJ 



2 

H 

? 



o S 
Z a 

S°c5 

33 

o 

13 nJ 
.2 *-* 

5 ’© 

6 aS 

H Q 



c 

o 



C5 

CU 



o 

-o 

o 

03 



© 

CJ 

03 

a 

a. 

CJ 

3 

o 

c/5 

"3 

CO 

s 

uT 

2 

*3 

co 

c 

3 

"3 

03 

c 

cj 



C 

CO 

0) 

H 









u 








s 








u 


>» 






CQ 

CJ 


•5 






C 


-Q 






_ O 


1 

O 






.Q C/5 

« Jg B 


c. 

2 

PC 


c 

0 ) 

E 

0 ) 


c 

© 

s 

© 


>% cj .3 

2 .2 E 

3 l 




CJ 


CJ 


*3 0-0 




CO 

£ 


CO 

s 


T3 3-«s 

< < .E 










0 ) 

E 


Si) 


j3 


i 


H 


.E ^ 


•5 Tt 














03 i-i 










CJ 




^a 




© c 
ox .5 




t/i 






o 


0 ) 


<o ~ 


CJ 


U 


e 


C/5 •© 


c 




o 


o e 


o 




2 


CU co 


2 




>> 








c 








co 




U JZ 




a. 




O CJ 




© 3 




.C «*- U 


c3 

u 


! 1 
•v T3 

E c 
o « 

2 js 


u 

<2 

§ 

E 

«5 

a. 


3 -g S 

CJ O c^ 

-5 ^ 

■O a o 

= 2 js ■-> 

a « a & 

W U 2 £ 

s « S 

JS i S c 
a J « o 


03 


o § 

<*- -a 


i § 

u -3 




CJ 3 


** « 


>> i 2 cu o 




gD C/5 

2 3 
u o 


<j s 
1 0 
§| 


“ b a E 
% « = 5 




< "35 


O .E 


u ts 3 .E 


C 

# o 

** 


C/5 

£ 

4J 

*E 3 

$ 1 
.s 1 

u u 

«£ c 
«S o 


tc., on rile and 
students 


'2 

afi U 

2 | 
« i 

<U CJ 

sc e 
u *o 

O 3 


o 

03 


® (A 

2 1 
CJ CJ 


gj U 

g? 


~ o 

2 >> 




jO 3 


3 -Q 

j= co 


— e: 
** a 

mm 




a ^ 


CJ TZ 


u e 




II 


2 2 
tt o 


C3 E 
H S 






c 








o 


c 

u 






IS 

E 

u 

o 


O —a 

CJ *3 




1 2 


— 3 

O 3 




>» s 


u. C/5 


~ O 


Needs 


i| 
2- 1 
e « 
«* c 

— * O 


•E c 
c "5 

<L> 3 

E « 


e cj c j 

= u 3 
(ft R X 




CJ ° 
11 


>» >> 

O ,fi 

g--o 


C V3 «« 

O 4) V 
■o ^ p 
3 O 5 




U a3 

• e 


E « 

M T3 
. » 


Cfl ** CL 

. £ s 

o 2 o 




00 .= 


OS C 


i-l £ CJ 



CVJ 

CD 



CO 



c... 



ON-SITE EVALUATION 



April 13, 1994 
Northwest Technical College 



Reasons for student enrollment 

Career change 
Prospect of a job 
Lateral move 

Lateral move, possible advancement in bio-med 
Convenience 



Student’s comments and concerns 



Safety course provides good background in safety 

Students understand that Jim is a new instructor and Jim has been doing his best 
Financial assistance is very good 

Placement information is vague, did not know of placement office 
Students are willing to research information for employment 

Jim should coordinate lecture with the lab, that is lab activity should be for lecture topic 
Should update computers, computer programs are outdated 
Should have more computer-skills courses 



Too many students for the amount of computers available 
Jim offers open-door policy for student concerns 
Some students are willing to relocate for jobs 

One student was concerned that there is little opportunity or time available for 
Students feel more lab equipment needed in lab 



physical fitness 
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Appendix F 

Copy of the Focus Visit Evaluation Form 
(Completed by the program improvement team at the 

end of the focus visit) 
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Minnesota s. Technical College System 

PROGRAM REVIEW FOCUS VISIT- THIEF RIVER FALLS CAMPUS 
Automotive Program - May 15-16, 1995 
Evaluation Form 



Cheekbone: Instructor Student Employer Rating. Scale: 1 = Poor 2= Below Average 

Advisory member Administratio n 3= Average 4 = Above Average 5= Excellent 



I. Timeliness of request to serve. Comments: 1 2 3 4 5 



II. Amount of time to perform the task. Comments: 



2 3 4 5 



III. Orientation to the task. Comments: 



2 3 4 5 



IV. Expectation of participants. Comments: 



2 3 4 5 



V. Program materials/information. Comments: 



2 3 4 5 



VI. Discussion time to complete the task. Comments: 



2 3 4 5 



VII. Time and instructions for report. Comments: 



2 3 4 5 
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Appendix G 

Form for the Six-Month Follow-Up Report 
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Program Improvement Plan 

Focus Visit Date 
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Appendix H 

Advisory Committee for the Focus Visit Report 
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Advisory Committee for the Focus Visit Report 

Mr. Eric C. Crane, Research Fellow, State Council on Vocational Technical Education, 
St. Paul 

Ms. Brenda M. Dillon, Executive Director, State Council on Vocational Technical 
Education, St. Paul 

Dr. Jerry J. Johnson, Dean of Instruction, Dakota County Technical College, 
Rosemount 

Dr. Mel Johnson, Vice-Chancellor of System Improvement Services (retired), State 
Board of Technical Colleges, St. Paul 

Ms. Karen Kedrowski, Management Analyst, Minnesota State Colleges and 
Universities, St. Paul 

Mr. Dayton Perry, Director of Accreditation and Evaluation, Minnesota State Colleges 
and Universities, St. Paul 

Ms. Ann Wood, Management Analyst, Minnesota State Colleges and Universities, 

St. Paul 
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The logo of the State Council on Vocational Technical Education is 
an abstract representation of the citizen-councilors assembled 
at a round table. Designed by a commercial art student at 
Alexandria Technical College, the design was selected in 
1982 from 69 entries submitted by vocational students 
in Minnesota’s high schools, secondary cooperative centers, 
and technical colleges. The Council made its selection on the 
basis of a recommendation by a panel of representatives from 
the graphic arts, public relations, and media industries in Minnesota. 



Purpose of the Council 

/ 

The State Council on Vocational Technical Education is designed to further public-private 
collaboration for the advancement of quality vocational programs responsive to labor 
market needs. Established in 1969 and designated as a state agency in 1985, the Council 
comprises 13 members appointed by the Governor. Seven members represent the private 
sector interests of agriculture, business, industry, and labor. Six of the members represent 
vocational technical education institutions, career guidance and counseling organizations, 
special education, and targeted populations: 

The Council advises the Governor, the State Board of Technical Colleges, the State Board 
of Education, the Governor’s Job Training Council, the business.community, the general public, 
and the U.S. Secretaries of Education and Labor. The Council advises on development of 
the annual state vocational plan; provides consultation on the establishment of program 
evaluation criteria and state technical committees; analyzes the spending distribution and 
the availability of vocational programs, services, and activities; reports on the extent to which 
equity to quality programs is provided targeted populations; recommends procedures to 
enhance public participation in vocational technical education; recommends improvements 
that emphasize business and labor concerns; evaluates the delivery systems assisted under 
the Carl D. Perkins Vocational Education Act and the Job Training Partnership Act (JTPA); 
and advises on policies that the state should pursue to strengthen vocational technical 
education, as well as initiatives that the private sector could undertake to enhance program 
modernization. 

To enhance effectiveness in gathering information, the Council holds at least one town meeting 
each year at which the public is encouraged to express its concern about vocational techni- 
cal education in Minnesota. To enhance its effectiveness in providing information, the Coun- 
cil publishes a quarterly newsletter, an annual directory, and a biennial report. These 
publications as well as project and activity reports are available to the public. 

Information on the date, time, and location of meetings and other activities is available by 
calling the Council Offices at 612/296-4202. 
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366 Jackson Street, Suite 314, St. Paul, Minnesota 55101 
TEL: 612/296-4202 • FAX: 612/297-7786 
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